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Abstract 

We model the formation of networks as the result of a game where by players 
act selfishly to get the portfolio of links they desire most. The integration of player 
strategies into the network formation model is appropriate for organizational networks 
because in these smaller networks, dynamics are not random, but the result of in- 
tentional actions carried through by players maximizing their own objectives. This 
model is a better framework for the analysis of influences upon a network because it 
integrates the strategies of the players involved. We present an Integer Program that 
calculates the price of anarchy of this game by finding the worst stable graph and the 
best coordinated graph for this game. We simulate the formation of the network and 
calculated the simulated price of anarchy, which we find tends to be rather low. 



1 Introduction 

In recent years, there has been extensive efforts to collect large amounts of data related 
to underlying social networks in order to characterize the social network in some useful 
way Social network analysis (and its various branches) is a large subject with several 
devoted texts e.g., (2}[3]. It is impossible to provide a complete literature survey in a short 
space and most of the papers are not necessarily germane to the topics discussed in this 
paper. Nevertheless, we provide a small sampling of the literature to illustrate the breadth 
of research in social network analysis. R] suggests methods for predicting future events based 
on social media, while [5] is specifically interested in the identification of specific anonymous 
individuals within a given social network. (6] investigates the problem of mathematically 
modeling crowd-sourcing. This work is extended in [7]. There is substantial interest from 
the statistical physics community in this problem in the form of Network Science (see the 
sequel). |8] investigate models for the growth of social networks. Very little of this work uses 
game theoretic principles as we do in this paper, however, [9] investigates the problem of a 
user deciding to join a social network from a game theoretic perspective. 

A specific application of this analysis is to aid in the discovery of a malicious network (e.g. 



an organized crime network). Interested readers can see 10 for a more commercial appli- 



cation of the same techniques. These methods are focused on the discovery of a subnetwork 
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with particular characteristics, but they do not offer insight into the analysis of potential 
courses of actions that may be taken to influence the network. For example, suppose that we 
consider the small five player organization shown in Figure In this organization, the red 




Figure 1.1: What will happen if the red node is removed? Will the network dissolve (left) 
or reform (right) 



node is the center of the organization. It seems intuitive that the center of the organization 
should be attacked in some way (e.g. captured or killed). However, it is unclear whether the 
organization will crumble as shown on the left by a set of disconnected nodes or if the graph 
will reform as a stronger network, as shown on the right. Let us instead consider a typical 
firm rather than a crime organization. If the CEO is removed for some reason (e.g. retires, 
is arrested, or dies), the firm may encounter a drop in the stock price or market shares as 
an indication of some struggling, however, it is very unlikely that it will collapse. If the firm 
does collapse, it will not be quick or as a sole consequence of this event. The firm will likely 
reorganize by replacing the CEO in some manner. Sometimes this benefits the firm as the 
new leader or reorganized organization is better than before and yet other times, the firm 
may encounter a steady decline under the new weaker leadership. It is our position that the 
analysis of player interaction in a crime organization should use the same methodologies as 
those for analyzing the interactions of players in other organizational environments. 

In this paper, we take the point of view that players in such a network will make strategic 
decisions on with whom to connect. These decisions may reflect instructions from a central 
authority, but it is the player who acts in his own best interest to carry these instructions 
out. Using a game theoretic model of players and how they connect, will allow us to model 
the reformation of a network as a result of an influential act upon it. In this respect, this 
approach seeks to shed light on the problem facing authorities after they discover such a 
malicious network. To our knowledge, no organization has attempted to use game theoretic 
techniques to study the network formation or reformation process to inform policy on kill or 
capture operations. 

While a game theoretic approach allows the analysis of influence on a network, it requires 
knowledge of the value functions of the players involved. It is not possible to have perfect 
knowledge of these value functions and we defer a discussion of this problem to future work. 
To be sure, application of this technique requires that player objective functions be estimated. 
However, such a requirement is not inconsistent with current operational requirements for 
identifying and targeting members of organizations. 
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2 Related Literature from the Physics Community 



The Network Science community has largely dedicated its efforts to the exposition and 
analysis of topological properties that occur in several real-world networks; e.g., scale-freeness 



11-14 . Recently, there has been interest in showing that these topological properties may 



arise as a result of optimization, rather than some immutable physical law 15 . As Doyle et 



al. 15 point out, various networks such as communications networks and the Internet are 



designed by engineers with some objectives and constraints. While it is true that there is 
often not a single designer in control of the entire network, the network does not naturally 
evolve without the influence of designers. In each application, the network structure must 
be feasible with respect to some physical constraints corresponding to the tolerances and 
specifications of the equipment used in the network. For example, in a system such as the 
world wide web, a single web-page might have billions of connections, however it is not 
possible for a node to have such a degree in many other applications, such as collaboration 
or road networks. Certainly the structure of the network has a significant impact on its [the 
network's] ability to function, its evolution, and its robustness. However network structures 
often arise as a result (locally) of optimized decision making among a single agent or multiple 
competitive or cooperative agents, who take network structure and function into account 
as a part of a collection of constraints and objectives. Recently, network formation has 



been modeled from a game theoretic perspective 16 -19 , and in 20 , it was shown that 



there exists games that result in the formation of a stable graph with an arbitrary degree 



sequence. In 21 , it was shown that a network with an arbitrary degree sequence may result 
as a pairwise stable graph with link bias in the player strategies. In this paper, we show that 
we may formulate an optimization problem to measure the price of anarchy of stable graphs 
for this network formation game. 



3 Preliminary Notation and Definitions 

Let AT = {1, 2, ... n} be the set of nodes (vertices) in a graph. Following the graph formation 



game literature 19 22 - 24 , a graph is denoted as g and represents a set of links (edges) (where 
a link is a subset of N of size two). This notation is consistent with the notion of a simple 
graph (i.e., a graph with out multiple edges or self-loops) in the standard graph theory 



literature; see, e.g., 25 . In this paper, it will be more convenient to denote a graph as 
x = (xij) where: 

{1 if node i is linked to node j 
else 

We assume xa = for alH 6 N. Note x is the symmetric adjacency matrix [26 1 for a graph 
g and we consider only non-directed simple graphs. Denote X as the set of all graphs over 
the node set N, that is, X = {x : x e {0, l} nxn }. 
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Let T]i(x) : X — > R denote the degree of node % in graph x, which is computed: 

r]i(x) = ^2xij = Xi.e (3.2) 

3 

where e is an n-dimensional column vector filled with l's, that is e = (1,1,... 1) T G 
R nxl . Denote r/(x) : X — > W 1 as the degree sequence of the graph x; i.e., i](x.) = 
(771 (x), r\i (x), . . . , r/ n (x)), which can be computed: 

r](x.) = xe (3.3) 

Note, we break slightly with the notation in the literature. In (e.g.) [27] a degree sequence 
is listed in descending order. We do not have this requirement as we we will be interested 
in conditions where certainly player's in a graph formation have a certain desired degree. 

Let [x],, be the equivalence class of graphs with the same degree sequence as x. A 
degree sequence d = (di, . . . , d n ) on n nodes is graphical, if there exists a graph with n 
nodes and degree sequence d = (di, . . . , d n ). The £ r norm between two degree sequences 
d = (d 1 , . . . , d n ) and k = (ki, . . . , k n ) is given as: 

n 

Hd-kU^^K-A^I (3.4) 

i 

We define a graph x to be closest in l\ norm to degree sequence d if it is a graph in X with a 
degree sequence that has the minimum i\ norm distance to d of all graphs in X. Naturally, 
this graph may not be unique. Formally, x is a closest graph to degree sequence d if: 

||r](x) — d||i = min ||^(x') — d||i (3.5) 



4 Network Game Notational Preliminaries 

In the network formation game, each player selects a strategy that consists of a set of 
preferences for with whom they would like to form a link. The preference of each player 
toward each link is represented in a matrix s where Sij denotes the preference for node i to 
link with node j: 

{1 if Player i desires to link with Player j 
else ' ( } 

We define Sa = to be consistent with our assumptions from the previous section. Player i 
will select strategy Sj. from the set of all possible strategies Si = {0, l} n_1 . In this game, each 
player has the ability to veto a link. That is, the formation of a link requires participation by 
both players as is consistent with many social networks. Hence each Player i selects strategy 
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Sj. and all together a strategy s = [sj.]j e jy is identified from S = Si x S 2 x ■ ■ ■ x S n . As a 
result of the strategy chosen, a simple graph x is formed: 

{1 if Sij Sji 1 . . 

else 

The value of a graph x is the total value produced by agents in the graph; we denote 
the value of a graph as the function v : X — > R and the set of of all such value functions as 
V. An allocation rule Y : V x X — > R n distributes the value u(x) among the agents in iV. 
Denote the value allocated to agent i as Yi(v,x). Since, the allocation rule must distribute 
the value of the network to all players, it must be balanced; i.e., 5^j^(f,x) = v(x) for all 
(f,x) e V x X. The allocation rule governs how the value is distributed and thus makes a 
significant contribution to the model. Denote the game Q = Q(v,Y,N) as the game played 
with value function v and allocation rule Y over nodes N. In this game, each agent (node) is 
a selfish profit maximizer who chooses strategy Sj. to maximize there allocated payoff under 
allocation rule Y and value function v. 



Jackson and Wolinksy 17 suggest that Nash Equilibrium analysis for this game may lead 
to inconsistencies between intuitive expected behavior and equilibrium behavior. A Nash 
Equilibrium is defined as any solution such that no player can unilaterally change strategies 
to benefit himself. For any potential link between two nodes i and j, the solution with no 
link (i.e., Xij = 0) is an equilibrium even if both players could benefit from the link. This 
is because each player has link veto power and therefore, no player can unilaterally create a 
link with any other player. 

In order to provide a more intuitive equilibrium concept for this model, Jackson and 
Wolinksy use pairwise stability to model stable networks without the use of Nash equilibria 



17 . We will first denote x + ij as the graph x with the additional link ij and x — ij as the 



graph x without the link ij. 

Definition 4.1. A network x with value function v and allocation rule Y is pairwise stable 
if (and only if): 

1. for all i, j if = 1, Fj(t>,x) > Yj(t>,x — ij) and 

2. for all i, j if = then, if Yi(v, x + ij) > Yi(v, x), then Yj(v, x + ij) < Yj(v, x) 

Pairwise stability implies that in a stable network, for each link that exists, (1) both 
players must benefit from it and (2) if a link can provide benefit to both players, then it, in 
fact, must exist. Jackson notes that pairwise stability may be too weak because it does not 



allow groups of players to add or delete links, only pairs of players 28 . Deletion of multiple 



links simultaneously has been considered in Belleflamme and Bloche 29 . Previously, in 



we extend work in 30 and 18 , showing that stable networks may be formed as a result of 
a link formation game with an arbitrary (desired) degree sequence. This work presupposes 
that we embed the degree sequence (implicitly or explicityly) into the objective functions of 
the players. 
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Theorem 4.2. Let f : R — > R &e a nonnegative convex function with minimum at and 
let d = (dx, . . . , d n ) be a degree sequence. In Q(v,Y,N), assume that Player i maximizes 
objective 3^(x) = — fa(r)i(x)) = — /(^(x) — c?j) = —f(J2j x ij ~ di). Assume that v is the 
balanced value function induced from the allocation rule Y = (Yi, . . . , F n ). If r]~ l (d) is non- 
empty (i.e., d zs graphical) then any graph x suc/i i/iai ?y(x) = d is pairwise stable for the 
the game Q (v, Y, N) . 

Proof. See |20). □ 



5 Link Bias 



The model presented in Theorem |4.2| requires that each player have a similar objective 
function and, essentially, a desired degree - or a special number of individuals to whom he 
wishes to connect. While this is a good first model for many applications, and establishes the 
relative ease with which Network Science metrics can be incorporated into a game theoretic 
framework, in real-world situations each player usually has a bias toward linking with a 
specific set of players rather than others. In this section, we incorporate a player's preference 
to link to one player over another. The incorporation of link bias does not change the fact 
that given any degree sequence, there exists a game that will result in a pairwise stable graph 



with such a degree sequence 21 



Assume each player minimizes a cost fa : X — > R. In this framework, we assume that 
li(x) = — /j(x) and the player maximizes l^(x). Consistent with Theorem 



4.2 



we assume 



the value function v in G(v, Y, N) is defined implicitly from the 3^(x) (i — 1, . . . , n) so that 
v is balanced. For the remainder of this section we assume a linear cost function: 



As in the prior model a link between players i and j exists if and only if the two players 
decide to link. That is, a player may unilaterally reject a link. 



5.1 Stability 

In this model, Player i will benefit from linking with any Player j whenever Cy < and 
Player % will be penalized for linking with any Player j whenever Cjj > 0. We may have an 
unspecified behavior when = Cji = 0. In this case it will neither help nor hinder either 
player to establish a link. To remove this possibility, we may assume link parsimony. That 
is, we will assume that a link is established if and only if both players benefit in some way. 
The stability condition becomes: 

Definition 5.1. A network x is pairwise stable if (and only if): 

1. for all if Xij = 1, then c^- < and Cji < 

2. for all if x^- = 0, then if c^- > then Cji < 
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We show in 21 , that given an arbitrary degree sequence d = (d\, . . . , d n ) we may con- 
struct a cost matrix c, whose components are the objective function coefficients c^-, such 
that the resulting graph formation game has as a (pairwise) stable solution a graph with 
degree sequence d. The construction of c is done by an optimization problem. 

Definition 5.2. As in the previous section, the preference of Player i to link with Player j 
is indicated via where: 



1 if player i can benefit from link ij 
if player i cannot benefit from link ij 

Remark 5.3. Specifically, Sij is the boolean mapping of Cif 

*-{; K>° <5 ' 2) 

Lemma 5.4. A graph x = (scy) is stable if and only if it satisfies the following constraints: 

■Eji V ij 

Sij ~t~ Sji 1 ^ X{j V %] 

Xij < Sij V ij (5.3) 
Xij < Sji V ij 



x 



Sij 6 {0,1} Vzj 



Proof. See 21 



□ 



Remark 5.5. Note the linearity of the constraints in both Sj,- and x^ suggests we could 



introduce additional constraints to the constraints in Expression 5.3 and solve for both x 
and s. If there is a feasible solution (x, s) to the constraints, then this solution can be used 
to generate a cost matrix c. In fact, it can be used to generate an infinite number of cost 
matrices, the simplest one given by: 

— 1 if = 1 . . 

5.4 

1 ifs o - = 1 J 

Proposition 5.6. Let d = (d\,d2, ■ ■ ■ ,d n ) be a degree sequence and consider the following 
constraints: 

^ = di V i 

Xij Xji V IJ 

(5.5) 



Xij 30 ji 


Vzj 


ji 1 ^ 30 


Vij 


30 %j ^ Sij 


Vzj 


30 ij ^ Sji 


Vzj 


Sij e {0,1} 


Vij 
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If (x, s) is a feasible solution to the constraints in Expression 5.5, c is a cost matrix con- 
structed from s as in Expression 5.J\ and fx, . . . , fx : X — > R are player cost functions with 
Yi(v,x) = — /j(x) = —J2j c ij x ij> ^en x = (x^) is a pairwise stable solution for Q{Y,v,N) 
and has degree sequence d = (di, g?2, . . . , d n ), where v is the balanced value function defined 
from Yi (i — 1, . . . ,n). □ 



5.2 Construction of Cost Matrix via Optimization 



If there is no feasible s to the constraints in Expression |5.5[ the first constraint may be priced 
out and the nonlinear integer program (Expression [5J5 ) may be solved to find a solution (x, s) 
such that the resulting graph x is pairwise stable for G(Y, v, N) as defined in Proposition |5.6 
and degree sequence of x is as close possible to d in the l\ metric. 



mm 



E 



E 



di 



i j^i 






V i < j 




Vij 




V ij 




Vij 


$ij i Sij G {0, 1} 


Vi,j 



(5.6) 



Problem 5.6 may be reformulated as Problem 5.7[ which has linear objective function and 
nonlinear constraints. 

min > e, 



s.t. 



E 



X i 



di 





Vi < j 




Vij 




Vij 




Vij 


$ij G {0, 1 j" 


Vi, j 



(5.7) 
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This problem can be reformulated as a purely linear integer programming problem (Problem 



5.8) 



min > e 7 




s.t. ^ ^ x^' di ^ C{ 


Vz 






^ ^ "I - d{ ^ 6^ 


Vi 






Sjj ~\~ Sji 1 ^ Xij 


V ij 


%ij — $ij 


Vzj 




Vzj 


Xij Xji 


Vi< j 


3«j G {0, lj 


Vi, j 



(5.8) 



Remark 5.7. The following theorem is an immediate result of the equivalence of Problem |5. 8 
and Problem |5.6 and Proposition 5J3 



Theorem 5.8. Suppose d = (di, di, ■ ■ ■ , d n ) is a degree sequence, (x, s) is an optimal solution 
to Problem 5.8, c is a cost matrix constructed from s as in Expression 5.4 and /i, . . . , /jv : 
X — > K are player cost functions with Yj(t>,x) = — /i(x) = — Ylj c ij x ij> then x = (xy) z's a 
pairwise stable solution for Q(Y,v,N) and has degree sequence as close as possible to d in 
the l\ metric, where v is the balanced value function defined from Yj (i = 1, . . . , n). 



Proof. See 21 



□ 



Remark 5.9. Theorem 5.8 shows how to construct a link biased game that encapsulates a 
specific degree sequence d. The resulting game (or class of games) hides the degree distribu- 
tion in the objective functions of the players in a non-obvious way, illustrating how arbitrary 
degree distributions can be hidden within the objective functions of individual players. This 
also suggests the need to investigate general value function inference from data, which we 
discuss in our future work. 



6 Price of Anarchy 

When networks form as a result of selfish competition among nodes, the resulting stable 
network may not, in fact, be system optimal. It is possible that a stable configuration is 
achieved in which each node does worse than if a central planner had optimized the system. 
In this circumstance, we would like to measure the collective penalization due to decentralized 
control. This collective price has been called the price of anarchy, which is measured as the 
ratio between the worst equilibrium and the centralized solution. 



The price of anarchy 31 is a method to measure the inefficiency of equilibrium, but 



the development of the analyisis of the inefficiency of equilibriums predates the price of 
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anarchy [32j. There already exists multiple variations of the price of anarchy (e.g. Pure 
Price of Anarchy, Mixed Price of Anarchy), for the different types of equilibriums that 
exist. In this paper, we have defined pairwise stability rather than using the typical Nash 
Equilibrium, so this foreshadows the presentation of an analogue to the price of anarchy in 
the sequel. 

The price of anarchy has been used to measure the inefficiency in congestion networks 



33,34 . In these games, each user of the network has a source and destination and they 
must pay a cost to travel from their source to their destination. The latency or cost of each 
link in the network increases with congestion, that is as the number of players that use it 
increases. Economically, we may think of capacity on the network (specifically between an 
origin destination pair) as a commodity being supplied. As more users want that commodity, 
the price increases. Each user will selfishly minimize his own cost via route selection. The 
inefficiency of the system is calculated by measuring the total cost of the system when users 
act selfishly versus the total cost when users act in a coordinated manner by a centralized 
solution. 

The price of anarchy is calculated as: 

= max xgX ^ Yfoc) = max xeE ^ ^(x) 
min xejB ]T\ Y { (x) min xeX £\ ft (x) 

where the set E C X is defined as the subset of equilibrium solutions. In this system, 
this ratio is a useful measurement because min xe x Y2i /«( x ) > 0- I* 1 models such as the 
traffic congestion model, there is an inherent minimum cost to traverse a link due to the 
fact that each link has a certain minimal traversal time. The congestion from other players 
and lack of capacity causes an additional cost, which is measured as a ratio of the physical 
cost. However, this property is simply not true of all games where players act selfishly. In 
models of network formation, there is not necessarily an inherent cost to the system. It is 
possible that due to the desires and constraints of the players involved, there is some cost 
that must be absorbed by some set of players, but this is due to the inconsistency of the 
players' desires, resources, and constraints. In the case where there is no such inconsistency 
and it is possible for all players to satisfy their desires, there is an optimal cost of zero. In 
these circumstances, for these applications, it does not make sense to examine the ratio as 
the denominator may be zero. Hence, we calculate the price of anarchy as: 

i i i i 

In this measurement, we measure the total additional cost of the worst selfish equilibrium 
over the best coordinated solution and denote this as the price of anarchy. 

The price of anarchy is a measure of the collective unhappiness of players due to selfish- 
ness. It is calculated as a function of the objective function of each player. Unless otherwise 
stated, we will return to the assumptions made in Section 4 that li(x) = — /^(^(x)) = 
—f(j]i(pc) — di) where / is convex with a minimum at 0. The shape of the function / will 
have a considerable influence on which graph is the worst stable. An infinitely steep function 
/ could have an infinitely large objective value for the worst equilibrium. 
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For computational ease and to obtain closed form theoretical results, we will consider 
fi(r)i(x)) = f(r]i{x.) — di) — |^i(x) — di\. This function provides additional insight into the 
game because, for the best and worst graph, it measures the l\ distance between the degree 
sequence of the graph generated through selfish decision making and a graph with the degree 
sequence closest in the l\ metric to the target degree sequence d. 

6.1 The Worst Stable Graph 
6.1.1 Link Bias Game 

Proposition 6.1. Assume c is a cost matrix in the link bias game Q(Y,v,N) where Yi = 
c ij x ij an d v is the balanced value function induced by Yi (i = l,...,n). Let be 
defined by Expression 5-4 If x. is a solution to the integer programming problem: 



IIlclX ^ ^ ^ ^ CijXij 
i 3 






Vzj 




V ij 




Vzj 




V ij 


Xij e {0, 1} 


Vij 



(6.3) 



then x is a stable graph with the minimum net payoff. 



Proof. This is clear from the objective function and Lemma 5.4 □ 



6.1.2 Degree Sequence Game 

Next, we consider the model where Player i has an allocation function Yj(t>,x) = — /^(^(x)) 
where fi : R — > R is convex with a minimum at di. In this section, we define an integer 
program to find the stable graph with the worst total allocation for the players involved in 
the game. The feasible region of this integer program will be the set of stable graphs. 

Remark 6.2. Define: 

r,.(x) = ( 1 >^,*-u) (64) 

else 



and 



and 



.1 if Yi(v, x + ij) > Yi(v, x) 

wMH else (e-s) 



fe( x) = ^ tf^*+«<^M (6 . 6) 

gIsg 



ii 



Since stability is simply a propositional statement with propositions rjj(x), Py(x) and ^(x), 
it can be shown that the following nonlinear integer programming problem will produce the 
stable graph with the minimal net payoff 35 : 



mm 




(6.7) 



(1 -Xij) +r y (x) > 1 W i,j 

Xij + (1 - Py(x)) + gy(x) > 1 V i, j 
e {0,1} Vi,j 



However, the integer programming problem in its raw form is highly non-linear and therefore 
not efficient for computing the worst stable graph that can result from an arbitrary Y^-(i>,x). 

Lemma 6.3. A graph x = (xy) with value function v and allocation rule Y^iv, x) = 
—fi(r)i(x.)) where /j is convex and has a minimum at di is pairwise stable if and only if: 

1. for all i, J2j^i x ij < d i 

2. for all i,j ^ i, if x^ = 1, then Y.i^i x u < d, L and Y J i^j x ij < d j 

3. for all i,j ^ i, Y.i^i x u < d i and x ij < d j x ij = 1 

Proof. Suppose x is pairwise stable. If for any Player i, Ylij^i x ij > di, then Player i could 
unilaterally drop one link and obtain a more favorable payoff. Thus, it is clear YljA x^ < 
di since we assumed Condition 1 of pairwise stability that for all i,j, if x^ = 1, then 
Yi(v, x) > Yi(v,ya — ij). Thus Constraint 1 must be true. Constraint 2 follows from this 
argument as well. If we assume for all i,j if x^ = then, if Yi(v,jc + ij) > YJ(t>,x), then 
Yj(v, x + ij) < Yj(v,x) then this is equivalent to assuming if x^ = then if ^2k& x ik < di 
then ^2 kj Lj Xjk = dj. If we take the contrapositive of Constraint 3, then we obtain: if x^ = 
then ^2 if LjXik = di or J2k^j x jk = dj. Using a simple logical equivalence, we may rewrite 
this expression as: if x^ = then if J2i^j x ik ^ di then J2k^j x jk = dj. Since we've proved 
Constraint 1 must hold, Ylii^j x ik di is equivalent to Y^i^j x ik < di- Thus, Constraint 3 
follows from Condition 2 of pairwise stability. 

Conversely, suppose these three conditions hold. The logical equivalence between Con- 
straints 1 and Constraint 3 and Condition 2 of pairwise stability has already been established 
in the forgoing argument. By Constraint 2, we know that if x^ = 1, then each Player i has 
degree at most d iy the value that maximizes his payoff function. Thus, setting x^ = (effec- 
tively constructing x — ij would yield a lower payoff for both Player i and Player j. Thus, 
Condition 1 of pairwise stability is established. □ 

Definition 6.4. Let u be a vector of slack variables on the degrees of the nodes in the game. 



Then: 
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Similarly, let z to be the binary mapping of the vector u with: 




1 if Ui > (i.e. Y,i^i x n < d i) 
if Ui = (i.e. Y.ijLi x u = di) 



Remark 6.5. Note we will not consider the case when Yltyi x h > di because each player has 
the unilateral power to veto any connection. 



Lemma 6.6. Let YJ(u,x) be as in the statement of Lemma 6.3. Let & be a degree sequence 
and let x = (xij) with vectors u,z derived from Definition 6.4 ■ Then x is stable if and only 
if the following constraints are satisfied: 



^ %ij Ui di 


Wi 




(6.8) 










Zf. | Z 'J l < ^~~- X % J 
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Zi < Ui 
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(6.10) 


— diZi 
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(6.12) 


u t >0 


Wi 




(6.13) 


Zi e {0,1} Mi 




(6.14) 


x i:j e {0,1} Vi,j 




(6.15) 



Proof. Suppose that x is stable and u and z are defined appropriately. Clearly, = Xji 
holds. By Lemma 6.3 we must have Ylii^j x ij — dj and so Ui > and Constraint 6.8 holds by 
definition. Further it is clear < Ui < di for all i. By Definition 6.4, if Ui = 0, then z\ = 
and thus Zi < Ui and Ui < diZ{. The fact that Ui G Z + is ensured by the integrality of x so 
if Ui > then u^ > 1 thus Ui > Zi = 1 and as we observed Ui < di = diZi. 

Conversely, suppose the constraints hold. That x is a graph is clear. Trivially, x ij — 
dj. Suppose that u^Uj > 0. 

Xi 



Then necessarily Z{,Zj = 1 since Constraint 6.11 must hold 



Thus, by Constraint 6.9 



1 and we have established the first and third constraint of 



Lemma 6.3, Conversely, suppose that Xi 



1. Then and z~ may take any value to 



satisfy Constraint |6.9 and the second constraint of Lemma (^3 must hold. This completes 
the proof. □ 



Theorem 6.7. Let Yi(v, x) be as in the statement of Lemma 6.3. Let d be a degree sequence 



The solution to the following integer programming problem yields a graph x that is stable and 
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has the worst net payoff function of any stable graph. 



max 



J2 Ui 
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Xij e {0, 1} 


Vi 





(6.16) 



Proof. The statement follows at once from Lemma 6.6 and the assumptions on Yi(v, x) made 
in Lemma [6.31 □ 

Example 6.8. Consider a simple example with 10 players who each have convex cost functions 
with minima at 5. That is, each player would prefer to link with no more and no less than 5 
other players. Thus, the ideal graph solution is one in which each player resides in a 5-regular 
graph. This setup yields an instantiation of the integer programming problem in Expression 
16161 

max 



i 






^ ^ %ij ~\~ Ui — 5 


Vz 










Zr^ | Z 'J l «3j £ J 


Vi, j 




Zi < Ui 


Vz 




Ui < 5zi 


Vz 




%ij ^ ji 


v«, j 




u % > 


Vz 




Zi e {0,1} 


Vz 




e {0, 1} 


Vz, j 





with solution visualized in Figure 6.1 If we assume the objective function of each player is 
fi(i](x.)) = \r]i(x) — 5|, then the worst case net payoff is 6. In this solution, we see Players 1 
and 2 both have degree 2, each missing 3 connections. 
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Figure 6.1: The worst solution to the problem in which 10 players each desired to link with 
5 players. The objective function in this case is 6. 



6.2 The Best Graph 
6.2.1 Link Bias Game 

Proposition 6.9. Assume c is a cost matrix in the link bias game Q(Y,v,N) where = 
c ij x ij an d v i> s the balanced value function induced by Yi (i = l,...,n). Let Sij be 



defined by Expression 5.2, If x is a solution to the integer programming problem: 



i j 

v ( 6 - 17 ) 
Xy G {0, 1} Wij 

then x is a (potentially unstable) graph with the maximum net payoff. □ 
6.2.2 Degree Sequence Game 

In this section, we define an integer program to find the graph with the best total allocation 
for the players involved in the game. Note that we are not necessarily looking for a stable 
graph, so the feasible region is the set of all graphs. This will provide a baseline to evaluate 
the worst price that may be paid for selfish competition (e.g. the Price of Anarchy). 

Remark 6.10. In the general case, the following nonlinear integer programming problem will 
yield the graph that provides the largest net payoff: 

max \J Yj(v, x) 

(6.18) 

x lj e{0,l} Vi,j 
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Again, the integer programming problem in its raw form may be highly non-linear and 
therefore not efficient for computing the graph of interest for any possible Yi(v, x). 

Previously, there has been work on generating graphs with an arbitrary graphical degree 



sequence 36 -39 . However this literature is mainly concerned with the algorithms to generate 



a graph for a graphical degree sequence. Here we seek to find the closest graph to any degree 
sequence (graphical or not) and we use an optimization formulation to do this. That is, 
we focus on the problem in which Yi(t>,x) = — \i]i(x) — di\. For our specific function, we 
formulate a math program by defining the feasible region as the set of all graphs and then 
minimizing the sum of the player's cost due to penalization for acquiring a degree different 
than desired. 



mm 



(6.19) 



i j^i 

s.t. — Xji = V i < j 
^£{0,1} Vz',j 

This nonlinear integer programming problem is easily reformulated to a linear integer pro- 
gramming problem: 

min 



Sit, ^^^^^ X %2 

^ %ij ~\~ di ^ 6j 

3¥* 



Vz 
Vz 

Vz < j 



(6.20) 



x^ e {0, 1} 

This integer program minimizes the distance between the arbitrary degree sequence d 
{g?i, . . . ,d n } and the degree sequence of a graph in the feasible region. 

Theorem 6.11. The graph generated by an optimal solution to the integer program: 

min Ci 

i 

i.t. ^ Xij di ^ 6j 



^ %ij ~t~ di ^ 6^ 
•Eij 

x^ E {0,1} 



Vz 
Vz 

Vz < j 
Vz, j 



(6.21) 



is a closest graph under the l\-norm to a graph with degree sequence d = {d±, . . . ,d n }. □ 
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Example 6.12. Now, the price of anarchy is simply the difference of the objective function 



value from the worst graph (Problem (6.16)) to the best graph (Problem (6.21)). Continuing 



Example |6.8[ the degree sequence in question is graphical. Thus, a globally optimal solution 
is one in which each player is adjacent to 5 other players. This is shown in Figure |6.2[ We 




Figure 6.2: A best solution to the problem in which 10 players each desired to link with 5 
players. The objective function in this case is and moreover, this graph is stable. 



note that this graph is not only a globally optimal solution, it is also a pairwise stable graph. 
As before, we are assuming that /i(7/(x)) = \r]i(x) — 5|. Since the objective function value is 



0, it is easy to see that that price of anarchy as defined in Equation 6.2 is 5 



6.3 Complete Example 

Using a link bias game, we can illustrate a complete example of the process by which a 
modeler might make use of these techniques. Suppose that after studying a 10 player decen- 
tralized network, a cost matrix c is constructed to identify link bias between players. This 
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cost matrix might be: 
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(6.22) 



Using this information, the worst net payoff stable graph can be identified from Problem 



6.3| The value to the organization under this strategy is 1077 units of reward. If the group 
were organized centrally, the value to the group would be 1487 units of reward, computed 



from Problem 6.17 The resulting graphs are shown in Figure 6.3 Since the two community 





(a) Worst Graph 



(b) Best Graph 



Figure 6.3: The worst stable graph and best centrally coordinated graph using the cost 
matrix c. 



payoffs are positive, we can analyze the price of anarchy using the traditional ratio method 
and we see that decentralized play leads to a approximately ~ 72% of the payoff that would 
come from centralized coordination. Naturally, if the player's true network resembled the 
centrally coordinated graph rather than the uncoordinated (stable) graph, we might suspect 
this network was not selfishly coordinating and our payoff matrix was incorrect. 
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Suppose now we isolate a vertex and target it for kill or capture. Without loss of gen- 
erality, we have identified that it is possible to kill or capture either Vertex 10 or Vertex 
1. In an ordinary network analysis, Vertex 10 is clearly a high priority target since it has 
the highest degree. We can explore the impact of removing Vertex 10 from the network by 
deleting the 10th row and column from c and recomputing. The resulting graphs are shown 



in Figure 6.4 In this case, the uncoordinated network fragments into a tree and a single, 




(a) Worst Graph 



(b) Best Graph 



Figure 6.4: The worst stable graph and best centrally coordinated graph after removing 
Player 10. 



isolated vertex. Furthermore, the new payoffs are 501 reward units for the stable network 
and 789 reward units for the new centrally coordinated network. The new price of anarchy 
(as a ratio) is ~ 63%, suggesting we have seriously impacted the ability of the network to 
achieve results as good as a centrally coordinated network. 

However, suppose it was easier to remove Vertex 1. If we execute this mission, the result- 



ing graphs are shown in Figure [675j In this case, the uncoordinated graph does not fragment 
at all and more importantly the new payoffs are 899 reward units in the uncoordinated stable 
graph and 1220 reward units in the centrally coordinated graph. The new price of anarchy 
(as a ratio) is ~ 74%. Removing Vertex 1 actually improves the relative performance of 
the network with respect to a centrally coordinated network. Thus we might conclude that 
given the opportunity to remove a vertex, we should choose to remove Vertex 10 rather than 
Vertex 1, even though these vertices have similar network characteristics. It is interesting 
to note in this example there is little correlation between the traditional measures of vertex 
importance and their impact on the resulting network's price of anarchy. Eigenvector cen- 
trality and vertex degree for the original worst stable graph (the assumed initial condition) 
and the resulting change in price of anarchy are summarized in the table below. Price of 
anarchy difference is computed as the original price of anarchy (~ 72%) minus new price of 
anarchy once a vertex is removed. We also include the Communal Change in Utility. This is 
the difference in the communal objective function in the original graph (10 players) and the 
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(a) Worst Graph 



(b) Best Graph 



Figure 6.5: The worst stable graph and best centrally coordinated graph after removing 
Player 1. 

communal objective function in the graph that results from removing a vertex (9 players). 
The computation is done for each player who could be removed. The information in the table 



Removed Vertex 


Degree 


Eig. Centrality 


POA Diff 


Communal Utility Change 


1 
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0.070066565 


-0.012608178 


178 
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0.085041762 


0.026391872 


153 


3 
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0.120257982 


0.065375238 


285 


4 


3 


0.115436794 


0.009530895 


190 


5 


2 


0.093603947 


0.011948301 


193 


6 


1 


0.063208915 


-0.03956057 


42 


7 


3 


0.092026999 


-0.072036296 


213 


8 


2 


0.102880448 


-0.05390475 


221 


9 


2 


0.066087279 


-0.003131446 


103 


10 


6 


0.191389311 


0.089296079 


576 



Table 1: Summary Table for traditional network importance measures and the corresponding 
impact on price of anarchy. 



is illustrated in Figures |6.6| and |6.7| It is interesting to note the lack of correlation in these 
plots. Obviously this is anecdotal evidence, but suggests interesting future work in so far as 
price of anarchy change may be a new way to measure the importance of a vertex in a social 
network of interest. We contrast these plots to the plots in Figure 6.7, where we illustrate 
the relationship between traditional network metrics and the change in the communal util- 
ity. There is clearly a substantial correlation between the degree of a vertex, it's eigenvector 
centrality and the extent to which the removal of this vertex impacts the communal utility. 
This is expected since for this game, we can compute the communal utility change when 
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Difference in Price of Anarchy vs. Vertex Degree 
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(a) Degree 



Difference in Price of Anarchy vs. Vertex Eigenvector Centrality 



0.0936D334J 
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Eigenvector Centrality 



(b) Eig. Cent. 



Figure 6.6: The price of anarchy change as a function of various vertex importance measures 
is illustrated. 




Figure 6.7: The net utility change as a function of various vertex importance measures is 
illustrated 
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vertex % is removed (AC/j) as shown in Equation 



6.23 



AUi - ^ s ijSji(cij + Cji) (6.23) 
j 

For each vertex z, when it is the removed vertex, AC/j simply sums up the lost utility for 
each vertex i and j for each link that existed in the network before removal. When sy = 
or Sji = 0, this implies the link did not exist and hence, no contribution is made to AC/j. 
Alternatively, when = Sji = 1, the contribution made to AC/j is the sum of the utilities 
received by vertex i and j, which is — (c^ + C/j). Since, = 1 only if Cjj < and = 1 only 
if Cji < 0, this means that when the link does exist —{pij + c ji) > 0- Hence, only positive 
contributions can be made to AUi for each link it has and hence it must be positively 
correlated with the degree of vertex i. However, since utility received by a link may be quite 
asymmetric when Cij << Cji, the communal utility change may differ greatly between two 
nodes with the same degree. 

This example illustrates the importance of understanding what network metrics mean 
in a given application. Because each player (and thus the community of players) derives 
benefit from being connected to specific players in this game, it is relatively straightforward 
to see that network metrics like eigenvector centrality and degree will be highly correlated 
to value functions like communal utility change; that is, how much removing a single player 
will decrease the total payoff to the network. On the other hand, it is clear that there is little 
relationship between the price of anarchy difference and the network centrality measure of 
a vertex. Thus, if the goal is to degrade the network's ability to accumulate utility, then 
using eigenvector centrality as a proxy measure in the link bias game should be acceptable. 
However, if the objective is to cause the network to function in the least centralized way 
possible, then eigenvector centrality may not be as good a proxy measure. 

The is most clear in the case when we attempt to optimize both of these objectives in a 
kill or capture mission at once. Consider Table [T] Suppose a decision maker's objective is 
to simultaneously maximize the decrease in communal benefits to the network and increase 
the price of anarchy as much as possible. Clearly, Vertex 10 is the ideal target; in fact it 
is the Pareto optimal solution for that multi-criteria optimization problem. If Vertex 10 is 
not accessible, then Vertex 3 is the next obvious target. It too has an un dominated payoff 
pair for that problem (the net benefit decrease is 285 reward units and the price of anarchy 
decreases from 72% to 66%). Interestingly, these two vertices have the highest eigenvector 
centrality but not necessarily the uniquely highest degree (in the case of Vertex 3). If Vertex 3 
also cannot be killed or captured, then the problem becomes more complicated. Eigenvector 
centrality is no longer a good proxy measure since the change in price of anarchy is not 
consistent with the change in communal utility. 

7 Simulation 

Networks that are pairwise stable for a game are pairwise stable because no player has an 
incentive to drop a link and no two players have an incentive to add an additional link. The 
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price of anarchy measures how much worse the worst possible stable graph is from the best 
for a particular game. However, this analysis does not offer insight into the actual formation 
of games. The simulation of network formation can offer some additional insight. Moreover, 
for exceptionally large games solving the Integer Programming Problems associated with 
computing the price of anarchy may be difficult. While it is relatively easy to solve Problem 



6.17 or Problem 6.19, it may be difficult to solve Problem 6.16 



7.1 Methodology 

In this subsection, we outline the methodology for simulating the formation of a network. 
We again denote the current graph as x where: 

{1 if node i is linked to node j 
else ( } 

We denote the matrix P as the matrix representing potential links: 

„ „ I 1 if node i could link to node j . 
p. ■ = p j{ = 1 J 7.2 

3 3 \0 else V ; 

A link ij is a potential link if: 

1. Link ij currently does not exist (xy = Xji = 0) 

2. Node % could benefit from linking to node j (i.e., 

3. Node j could benefit from linking to node i (i.e., 'Yl l i x ji < dj) 
Now, we introduce our simulation algorithm: 

1. Initialize = 0, Pij = 1 for all links ij 

2. While there exists a potential link (i.e., A? > ^) : 

(a) Randomly select a potential link ij (i.e. randomly choose a pair (i,j) such that 
Pii = 1) 

(b) Add link ij to the graph, set Xij = l,Xji = 1 

(c) Delete link ij from the potential links, set = 0,Pji = 

(d) If node i cannot benefit from linking to any more nodes (Ylk x ik — ^i), then 
remove all of their potential links. That is, set Pq- = and Pki = for all k 

(e) If node j cannot benefit from linking to any more nodes (^2 k Xjk > dj), then 
remove all of their potential links. That is, set Pjk = and Pkj = for all k 
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7.2 Numerical Example 



Suppose that we want the degree sequence of a stable graph that results from playing the 



game described in Theorem |4.2| to have a power law degree distribution. We embed this into 
the objectives of the players, so the resulting graph has the proper distribution. Let n = 100 
players attempt to minimize their cost function 

fi(vi(g)) = f(vi(g) - h) = h(g) - h\ 

where the parameter ki for each player and the degree distribution of ki values may be 



found in Table 7.1 The distribution of the ki values form an approximate (with rounding 



to integers) power law distribution as illustrated in the histogram in Figure 7.2 We note 



that this degree sequence is graphical. Thus the solution to Problem 6.21 yields an objective 
function that is 0. 
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Figure 7.1: ki values and degree distribution 




Figure 7.2: The ki values follow an approximate power law distribution 



The price of anarchy is the difference of the objective function value from the worst graph 



(Problem (6.16)) to the best graph (Problem (6.21)). 



We simulated this game 100 times using the methodology from Section 7A_ to find further 
insight. In Figure 7.3 we show the simulation statistics for the degree distribution. For 
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example, we see in Figure 7.1 that five nodes would optimize their objectives if they had a 
degree of three. In Figure 7.3 , we see that in all of the simulations, the minimum number of 
nodes with a degree of three was four and the maximum number of nodes with a degree of 
three was six. Since, the twenty-fifth and seventy-fifth percentile was five, we know that in 
more than half of the simulation runs, five nodes had a degree of three and optimized their 
objective. In the other half of the runs, there was only one node too many or one node too 
few with a degree of three, this small variation indicates that most nodes get close to their 
optimum degree resulting in a rather small price of anarchy. The simulation statistics are 



also visually presented as a box plot in Figure 7.2 In each simulation run, we calculated the 
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Figure 7.3: Degree Distribution Simulation Results 



Degree vs Simulated Number of Nodes Degree 
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price of anarchy and plotted the results as a histogram in Figure |7.4| Note the largest price 
of anarchy is 10, suggesting that this is the true price of anarchy for the system. That is, 
the worst possible outcome of communal utility in competitive play minus the best outcome 
in centralized decision making (which is zero, since the degree sequence given is graphical). 
The price of anarchy is rather low in most simulation runs. We investigated the distribution 
of the contributions to the price of anarchy. As shown in Figure |7.5[ the contributions to the 
price of anarchy were of higher magnitude and made more often by nodes with a greater k{ 
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Figure 7.4: The empirical distribution of the price of anarchy, 
value. This means that players that desired more links were more often more unhappy than 



other nodes who desired a lower degree. That being said, Figure 7.5 and Figure 7.4 show 
that most player's attain their desired degree in most of the simulations. 
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Figure 7.5: Price of Anarchy Contributions by Degree 



8 Conclusion and Future Directions 

In this paper we have studied game theoretic explanations for the formation of networks. We 
have shown that networks with interesting structures may emerge as the result of interactive 
play between competitive individuals. We have also illustrated a method for computing the 
price of anarchy for two types of network games and illustrated the application of this calcu- 
lation to kill or capture operations on violent extremist and criminal groups. We concluded 
by showing how simulation could be used for evaluating larger networks of interest when 
optimization problems become infeasible. There are several future directions of work. 

We would like to investigate more complex and more realistic games that will, ideally 
produce more lifelike behavior. To do this, we must be able to infer the objective functions 
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of the various players. In practice, these are never known and must be estimated, and it may 
be quite difficult to even estimate them. It is simply not possible to perfectly observe an 
entire graph at a single instance in time. Even if it were possible, relationships often cannot 
be characterized by a single binary variable. Nonetheless, each time a graph is observed, 
information about the game can be extracted. Investigating the process of identifying these 
objective functions is fundamental to extending these techniques to real world situations. 

In addition to this, more theoretical work can be done. Obtaining theoretical bounds on 
the price of anarchy and on the change in the price of anarchy as a result of vertex removal is 
in keeping with the literature on network formation games. In addition to this, investigation 
of more complex games in which constraints on players influence strategies is of interest. 
The generalized Nash equilibrium games 40 may be of interest in this case and will provide 
a richer context in which to model player behavior and therefore more requirements on our 
ability to infer player objectives and constraints from observed graphs. 
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